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(54) DATA PROCESSING APPARATUS 

(57)Abstract: 

PROBLEM TO BE SOLVED: To specify a watermarked material item with high 
probability and to lower the probability of missing. 

SOLUTION: One code word in a set of prescribed code words is introduced to a 
copy of an original material item, and a watermarked version of the original material 
.tern is created. The code word is generated by a pseudo random number generator 
which is initialized by a seed value. The seed value is used for the purpose of 
specifying the watermarked material item from the code word generated by the seed 
value. The code word is reproduced from the watermarked material item, all code 
words in the set of code words are made correlative with a reproduced code word, 
and the specific copy of the watermarked material item is detected. 
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CLAIMS 

[Claim(s)] 
[Claim 1] 

In the detection data processor which identifies the group of one or more 
predetermined codewords which exist in the version to which the water mark of an 
original material item was given generated by combining each codeword multiplier 
corresponding to each sample of an original material, respectively, 
The registration processor which relates the sample of the version to which the 
water mark of the above-mentioned original material item was given with the sample 
to which the original material item with which the above-mentioned codeword 
multiplier which carries out correspondence was combined corresponds, 
The playback processor which reproduces a codeword and generates a playback 
codeword by comparing the sample of the above-mentioned original material item 
with the sample to which the version to which the above-mentioned water mark was 
given corresponds, 

The correlation processor which generates a correlation value by making the above- 
mentioned playback codeword and the generated codeword correlate about each 
codeword in the group of the above-mentioned predetermined codeword, 
The detection data processor equipped with the detection processor which detects 
one or more codewords based on the correlation value exceeding a predetermined 



threshold of a codeword. 
[Claim 2] 

The above-mentioned registration processor, 

About the sample of the above-mentioned original material item, and the sample of 
the version to which the above-mentioned water mark was given, a correlation value 
is computed for each [ to the version to which this water mark of the sample of this 
original material item was given ] the shift of every, 

The 1 st [ to the version to which the above-mentioned water mark was given ] 
registration location in the above-mentioned original material item is judged from the 
shift which shows the highest correlation value among each above-mentioned shift, 
The exaggerated sampling of the version to which the above-mentioned original 
material item and the above-mentioned water mark were given is carried out. 
About the version by which the exaggerated sampling of the version to which the 
sample and the above-mentioned water mark of the above-mentioned original 
material item were given was carried out, a correlation value is computed for each 
[ to the registration location of the above 1st ] the shift of every, 
The detection data processor according to claim 1 characterized by judging the 2nd 
registration location from the shift which shows the highest correlation value among 
each shift of a version by which the exaggerated sampling was carried out [ above- 
mentioned ]. 
[Claim 3] 

The above-mentioned registration processor, 

About the registration location of the above 2nd, the difference between each 
sample of the above-mentioned original material item and each sample to which the 
version to which the above-mentioned water mark was given corresponds is 
computed, 

the above — difference — a predetermined threshold — comparing — this — the 
detection data processor according to claim 1 or 2 characterized by permuting the 
sample of the version to which the this registered water mark was given by the 
sample to which the above-mentioned original material item corresponds when 
difference is over this threshold. 
[Claim 4] 

They are claim 1 which the above-mentioned correlation processor is equipped with 
the codeword generation machine which generates the pseudo-random number for 
generating a playback codeword multiplier, and is characterized by generating this 
pseudo-random number from the seed value generated based on the sample of the 
version to which the above-mentioned water mark was given thru/or a detection 
data processor given in 3 any 1 terms. 
[Claim 5] 

It is introduced into a material item in a discrete cosine transform field, and the 

above-mentioned codeword is the detection data processor concerned. 

When it has the discrete cosine transform processor which changes into a discrete 



cosine transform field the version to which the above-mentioned water mark was 
given, and an original material item and the above-mentioned playback processor 
subtracts the discrete cosine transform multiplier to which the version to which the 
above-mentioned water mark was given corresponds from the discrete cosine 
transform multiplier of the above-mentioned original material item, they are claim 1 
characterized by generating the above-mentioned playback codeword thru/or a 
detection data processor given in 4 any 1 terms. 
[Claim 6] 

In the coded data processor which generates the version to which at least one 
water mark of this original material item was given by introducing one codeword in 
the group of a predetermined codeword into the copy of an original material item, 
The codeword generation machine which generates the codeword which has two or 
more codeword multipliers from the predetermined group of the above-mentioned 
codeword, 

Each above-mentioned codeword multiplier is combined with two or more samples to 
which the above-mentioned original material item corresponds, and it has the coding 
processor which generates the version to which the above-mentioned water mark 
was given, 

It is the coded data processor characterized by for the above-mentioned codeword 
being generated by this codeword using the pseudo-random number generation 
machine initialized by the seed value related with the proper, and generating the 
above-mentioned codeword multiplier from the numeric value generated with this 
pseudo-random number generation vessel. 
[Claim 7] 

The above-mentioned codeword generation machine is a coded data processor 
according to claim 6 characterized by generating the above-mentioned seed value 
from the sample of the above-mentioned material item. 
[Claim 8] 

The discrete cosine transform processor which changes the above-mentioned 
material item into a discrete cosine transform field, 

The material item of the above-mentioned discrete cosine transform field It is 
expressed by two or more discrete cosine multipliers. The above-mentioned coding 
processor By adding one of the above-mentioned codeword multiplier and the 
corresponding discrete cosine transform multipliers By combining the above- 
mentioned codeword multiplier and the above-mentioned material item, and carrying 
out the reverse discrete cosine transform of the image with which the above- 
mentioned codeword was added by this coding processor and by which the discrete 
cosine transform was carried out [ above-mentioned ] A coded data processor 
[ equipped with the reverse discrete cosine transform processor which generates 
the version to which the water mark of the above-mentioned material item was 
given ] according to claim 6 or 7. 
[Claim 9] 



Projection equipment equipped with claim 6 which at least one of an audio signal and 
picture signals is supplied, and introduces a codeword into at least one of this audio 
signal and picture signals before copy processing thru/or a coded data processor 
given in 8 any 1 terms. 
[Claim 10] 

A web server equipped with claim 6 which it is the web server which offers the 
material item downloaded through the Internet, this material item is supplied before 
this material item downloads, and introduces a codeword into this material item 
thru/or a coded data processor given in 8 any 1 terms. 
[Claim 11] 

In the addressee specification system which specifies the addressee of a material 
item, 

Claim 6 which generates the material item to which the water mark was given by 
introducing into a material item the codeword generated from the seed value which 
specifies the above-mentioned addressee as a proper thru/or a coded data 
processor given in 8 any 1 terms, 

An addressee specification system equipped with claim 1 which detects the 
addressee of this material item by predetermined incorrect detection probability by 
detecting the existence of the codeword in the above-mentioned material item 
thru/ or a detection data processor given in 6 any 1 terms. 
[Claim 12] 

In the discernment approach of identifying the group of one or more predetermined 
codewords which exist in the version to which the water mark of an original material 
item was given generated by combining each codeword multiplier corresponding to 
each sample of an original material, respectively, 

The step which relates the sample of the version to which the water mark of the 
above-mentioned original material item was given with the sample to which the 
original material item with which the above-mentioned codeword multiplier which 
carries out correspondence was combined corresponds, 

The step which reproduces a codeword and generates a playback codeword by 
comparing the sample of the above-mentioned original material item with the sample 
to which the version to which the above-mentioned water mark was given 
corresponds, 

The step which generates a correlation value by making the above-mentioned 
playback codeword and the generated codeword correlate about each codeword in 
the group of the above-mentioned predetermined codeword. 

The discernment approach of having the step which detects one or more codewords 
based on the correlation value exceeding a predetermined threshold of a codeword. 
[Claim 13] 

In the water mark addition approach which generates the version to which at least 
one water mark of this original material item was given by introducing one codeword 
in the group of a predetermined codeword into the copy of an original material item, 



The step which generates the codeword which has two or more codeword multipliers 
from the predetermined group of the above-mentioned codeword, 
Each above-mentioned codeword multiplier is combined with two or more samples to 
which the above-mentioned original material item corresponds, and it has the step 
which generates the version to which the above-mentioned water mark was given, 
The step which generates the above-mentioned codeword. 

The step which initializes a pseudo-random number generation machine with the 

seed value related with the above-mentioned codeword by the proper, 

The water mark addition approach characterized by having the step which generates 

the above-mentioned codeword multiplier from the numeric value generated with the 

above-mentioned pseudo-random number generation vessel. 

[Claim 14] 

The data signal showing the material item to which the codeword was added by 
claim 6 thru/or the coded data processor given in 8 any 1 terms. 
[Claim 15] 

Data medium with which the data signal according to claim 1 4 was recorded. 
[Claim 16] 

The computer program which offers the instruction which can be executed by 
computer which it is loaded [ computer ] to a data processor and operates this data 
processor as claim 1 thru/or a detection data processor given in 5 any 1 terms or 
claim 6 thru/or a coded data processor given in 8 any 1 terms. 
[Claim 17] 

The computer program which offers the instruction which can be executed by 
computer which it is loaded [ computer ] to a data processor and makes this data 
processor perform an approach according to claim 1 2 or 1 3. 
[Claim 18] 

The computer program product equipped with the medium which can be read by 
computer by which the information signal showing a computer program according to 
claim 16 or 17 is recorded. 
[Claim 19] 

The receiving set which combines with this input signal at least one codeword which 
is the receiving set which receives the signal showing a material item, is equipped 
with claim 6 thru/or a coded data processor given in 8 any 1 terms, and identifies an 
input signal to a proper. 
[Claim 20] 

The detection data processor or coded data processor explained below with 
reference to an attached drawing. 
[Claim 21] 

The discernment approach or the water mark addition approach explained below with 
reference to an attached drawing. 



DETAILED DESCRIPTION 



[Detailed Description of the Invention] 
[0001] 

[Field of the Invention] 

This invention relates to the coded data processor and approach of embedding a 
codeword (code words) at the version of a material item. In some applications, a 
codeword is used in order to identify a material item. Corresponding to this, this 
invention relates to the data processor and approach of detecting one or more 
codewords embedded at the material item. 
[0002] 

[Description of the Prior Art] 

In order to identify a material, the processing which embeds information to a 

material is called water marking processing. 

[0003] 

A discernment codeword is embedded at the version of a material item, in order to 
identify the version of a material item. That is, the addressee of the specific version 
of a material can be specified by water marking processing. Here, when a material is 
copied or used for the intention of the distribution person of a material in a not 
suitable form, a distribution person can specify the version of a material from a 
discernment codeword, and can take a suitable cure. 
[0004] 

the material item which set on these specifications, and was copied or used for the 
intention of the feeder of a material, an owner, an implementer, or a distribution 
person in the not suitable form — expedient — the OFENDINGU item (offending 
item) of a material, or OFENDINGUMATE — being real (offending material) — it calls 
[0005] 

Materials may be any of a material (information bearing material) including a video 
material, an audio material, an audio / video material, a software program, a digital 
document, and what kind of information. 
[0006] 

In order to make the structure of a water mark successful, it needs to be difficult for 
a user to remove identification code as much as possible. Moreover, it also needs to 
be difficult for a user to change identification code and to show others the 
implementer of the OFENDINGU item of a material as much as possible. An 
alteration as whose mask of a codeword or codeword by such user shows other 
users is called a KORUJON attack (collusion attack). 
[0007] 

[Problem(s) to be Solved by the Invention] 

It is necessary to make it it become difficult in the structure of all water marks for 
the user who received the copy of the same material to succeed in a KORUJON 



attack. Therefore, the structure of a water mark needs to be what can specify the 
material item to which the water mark set as the object of a KORUJON attack is 
given by the high probability, this specification — OFENDINGUMATE — since real, it 
realizes by identifying the reproduced codeword. The probability (overlooking 
probability: false negative probability) judged as on the other hand a codeword not 
existing in a codeword existing must be low. Furthermore, the probability (incorrect 
detection probability: false positive probability) judge that is the user who performed 
the malfeasance accidentally [ user / who has not participated in a KORUJON 
attack in fact ] must be made as low as possible. 
[0008] 

U.S. Pat. No. 5664018 is indicating the water marking processing which attaches the 
digital water mark created from the codeword which has the multiplier of a 
predetermined number from a material to two or more copies. The material item to 
which a water mark is given is an image. The equipment which performs **** of the 
water mark currently indicated here changes an image into a discrete cosine 
transform (it is called DOT below Discrete Cosine Transform:.) field. A digital water 
mark has normal distribution and consists of groups of a multiplier distributed at 
random. In a DOT field, each codeword multiplier corresponding to each DOT 
multiplier is added, respectively. The detailed mathematical analysis of this water 
marking processing for preventing an attack is indicated by July 27, 1998 which is 
the reference relevant to this, Jay Kilian (J. Kilian) published from MIT, EFU tea 
Layton (F. T.Leighton) work, and "protection (Resistance of Digital Watermarks to 
Collusion Attacks) of the digital water mark to a KORUJON attack." 
[0009] 

[Means for Solving the Problem] 

As the 1st side face of this invention, this invention offers the detection data 
processor which identifies the group of one or more predetermined codewords which 
exist in the version to which the water mark of an original material item was given. 
The version to which the water mark was given is generated by combining each 
codeword multiplier corresponding to two or more samples of each of an original 
material, respectively. A detection data processor is equipped with the registration 
processor which relates the sample of the version to which the water mark of an 
original material item was given with the sample to which the original material item 
with which the corresponding codeword multiplier was combined corresponds. A 
detection data processor by comparing the sample of an original material item with 
the sample to which the version to which the water mark was given corresponds 
further The playback processor which reproduces a codeword and generates a 
playback codeword, The correlation processor which generates a correlation value 
by making a playback codeword and the generated codeword correlate about each 
codeword in the group of a predetermined codeword, Based on the correlation value 
exceeding a predetermined threshold of a codeword, it has the detection processor 
which detects one or more codewords. 



[0010] 

As the 2nd side face of this invention, this invention offers the coded data 
processor which generates the version to which at least one water mark of an 
original material item was given by introducing one codeword in the group of a 
predetermined codeword into the copy of an original material item. A coded data 
processor is equipped with the codeword generation machine which generates the 
codeword which has two or more codeword multipliers from the predetermined group 
of a codeword. Furthermore, a coded data processor combines each codeword 
multiplier with two or more samples to which an original material item corresponds, 
and is equipped with the coding processor which generates the version to which the 
water mark was given. A codeword generation machine is equipped with a pseudo- 
random number generation machine. A codeword generation machine initializes a 
pseudo-random number generation machine with the seed value related with the 
codeword by the proper, and generates a codeword from the numeric value 
generated with the pseudo-random number generation vessel. 
[0011] 

This invention aims at offering the realistic water mark system using the codeword 
which has a multiplier which is indicated by U.S. Pat. No. 5664018, and which was 
distributed at random. In this invention, the pseudo-random number generation 
machine which constitutes some of detection data processors and coded data 
processors is used. A pseudo-random number generation machine determines the 
sequence of the numeric value to which a pseudo-random number generation 
machine generates a seed value using a seed value. The seed value is related with 
the version of the material item to which the water mark where the codeword 
generated from this seed value was embedded was given by the proper. Therefore, 
the version of the material item to which the water mark was given can be easily 
specified with this seed value. 
[0012] 

The detection data processor based on this invention is equipped with a registration 
processor. By the registration processor, the engine performance of a detection 
data processor becomes still higher. By making the version to which the water mark 
of a material item was given correspond to the original copy of a material item, and 
registering it, the probability for existence of a codeword to be detectable becomes 
high, and can lower a overlooking probability (false negative probability). It is because 
the sample of the material item to which, as for this, the water mark was given has 
high possibility of corresponding to the sample of an original material item, so the 
probability which can reproduce a codeword becomes high. 
[0013] 

In the desirable example of this invention, the seed value of a codeword is drawn 
from the value of the sample of an original material item. It becomes unnecessary 
thereby, to send and receive the seed value over each codeword between a coded 
data processor and a detection data processor. 



[0014] 

The further side face and the further description of this invention are defined in the 

attached claim. 

[0015] 

[Embodiment of the Invention] 

A general view of a water mark system 

Hereafter, the gestalt of operation of this invention is related to protection of a 
video image, and it explains. The number of copies is determined by the number of 
the users who should distribute a video image. The discernment codeword 
(identification code word) for identifying the copy assigned to one of these users is 
added to each copy. 
[0016] 

A video image is one example of the material protected by embedding a digital 
codeword. The material protected by embedding a codeword may be a material 
including a software program, a digital document, music, an audio signal, and what 
other kinds of information other than a video image. 
[0017] 

Drawing 1 is the block diagram showing the concrete configuration of the coded- 
image processor (encoding image processing apparatus) which introduces a 
discernment codeword into the copy of an original image. The original image I is 
supplied from the source and saved at a frame memory 1. This original image is 
copied as two or more copies to which the water mark was given (reproduce), and 
the discernment codeword of a proper is given to each copy. An original image is 
supplied to the DCT processor 2, and the DCT processor 2 divides an original image 
into the pixel block of 8x8, and performs DCT processing to each pixel block of 8x8. 
Thereby, the DCT processor 2 generates the DCT resolution picture V. 
[0018] 

In the following explanation, the vocabulary a "sample" shall point out the discrete 
sample which constitutes an image (or you may be the material of other classes in 
fact.). A sample may be a brightness sample of the image which can be copied also 
from a pixel. Therefore, vocabulary called a sample and vocabulary called a pixel may 
be exchangeable depending on a situation. 
[0019] 

The DCT image V is supplied to the coding processor (henceforth an encoder) 4. 
The discernment codeword is also supplied to the coding processor 4 from the 
discernment codeword generation machine 8. 
[0020] 

Two or more seed values (seed) are supplied to the discernment codeword 
generation machine 8. Each seed value is used in order to generate one of the 
discernment codewords which correspond, respectively. Each generated 
discernment codeword is embedded to the copy of an original image, and the image 
to which the water mark was given by this is generated. The discernment codeword 



generation machine 8 is equipped with a pseudo-random number generation machine. 
A pseudo-random number generation machine generates the codeword multiplier for 
forming a specific discernment codeword. In a desirable example, a codeword 
multiplier is generated based on normal distribution. In addition, it may replace with 
this and a codeword multiplier may be beforehand defined based on the seed value 
used since a pseudo-random number generation machine is initialized. Therefore, a 
corresponding seed value exists in each discernment codeword, and each seed value 
is memorized by memory 12. That is, in order to generate the discernment codeword 
Xi, the seed value seedi is read from memory 12, and the pseudo-random number 
generation machine in the discernment codeword generation machine 8 is initialized 
using this seed value seedi. 
[0021] 

The DCT version of an original image is expressed in the following explanation as V. 
It is here, 

V={vi}= {v1, v2, v3, v4 vN} 

It comes out, and it is and vi is the DCT multiplier of an image. In other examples, vi 
is the sampled value of an image and may express the sampled value of the image in 
the sampled value of an image in a space field, or other fields. 
[0022] 

Each discernment codeword Xi consists of codeword multipliers of n pieces as 
follows. 

Xi={xij}= {xi1, xi2, xi3, xi4, xin} 

Several n of a codeword multiplier corresponds to the measurement size of the 
original image V. In addition, the number of multipliers may differ and this number 
may be determined according to specific application. 
[0023] 

And the vector of the codeword multiplier which constitutes the i-th discernment 
codeword Xi is supplied to an encoder 4 through a channel 14. An encoder 4 
generates the image Wi to which the water mark was given by adding the 
discernment codeword Xi to Image V. In fact, as shown in the following formulas, the 
image Wi to which the water mark was given is generated by applying each codeword 
multiplier to each multiplier of an image. 
Wi=V+Xi 

Wi=v1+xi1, v2+xi2, v3+xi3, v4+xi4 vn+xin 

As shown in drawing 1 , the image Wi to which the water mark was given is 
outputted by it from this image processing system, after reverse DCT conversion is 
carried out by the reverse DCT processor 1 8 which carries out reverse DCT 
conversion of the image generated by the encoder 4. 
[0024] 

Therefore, as shown in drawing 1 , from an encoder 4, the group of the image to 
which the water mark was given is outputted. If data word is made into a maximum 
of 20 bits, one of the 10 million discernment codewords can be chosen, and the 



version Wi to which 10 million water marks were given can be generated to an 

original image. 

[0025] 

Although the copy Wi to which the water mark of Image I was given is discriminate 
according to an individual with this discernment codeword, in other examples, data 
can be sent within an image by above-mentioned 20 bits. Therefore, 20 bits of 
payloads of 20 bits for sending data within Image V used in order to choose a 
discernment codeword so that it may explain below are offered. 
[0026] 

The coded-image processor which is shown in drawing 1 and which generates the 
image to which the water mark was given is built into various products in various 
different scenarios with which this invention is applied. For example, a coded-image 
processor can be connected to a website or a web server, and the image to which 
the water mark was given can be downloaded. Before downloading the copy of an 
image, the codeword of a proper is introduced into the image to download and the 
codeword of this proper can detect the addressee of the downloaded image behind. 
[0027] 

In other examples of application, a coded-image processor is incorporated as some 
digital projectors (digital cinema projector), and in a movie theater, in case a 
discernment codeword projects a movie, it is added to an image. By this discernment 
codeword, the projector and movie theater which the movie projected can be 
pinpointed. Therefore, the projector and movie theater where the pirate edition copy 
was created can be pinpointed by the discernment codeword contained in the pirate 
edition copy which photoed the image projected from the projector and was obtained. 
On the other hand, the image to which the water mark was given may be copied as a 
photograph or printed matter, and may create and distribute the copy of the copied 
photograph or printed matter. In drawing 1 , the distribution place of the image to 
which the water mark generated by the coded-image processor was given is shown 
by the distribution 1 9 expressed by the cloud-shaped frame. 
[0028] 

Detection processor 

Drawing 2 is the block diagram showing the configuration of the detection image 
processing system (detecting image processing apparatus) which detects one or 
more codewords currently embedded in the OFENDINGU image (offending 
markedimage) to which the water mark was given. Speaking comprehensively, the 
detection image processing system shown in drawing 2 having the function to 
identify one or more codewords which exist in OFENDINGU of an image, i.e., a copy. 
[0029] 

OFENDINGU version W of the image to which the water mark was given is supplied 
from the source of data, and is saved at a frame memory 20. Since the detection 
processing in this detection image processing system needs the original version of 
an image, the original version of an image is saved at the frame memory 24. The 



original version of OFENDINGU version W of the image to which the water mark was 
given, and an image is supplied to the registration processor (registration processor) 
30 through the connection channels 26 and 28 according to individual, respectively. 
[0030] 

As mentioned above, OFENDINGU version W of an image may have been generated 
by photoing or copying some images Wi to which the water mark was given. Then, in 
order to raise the detection ratio of a discernment codeword, the registration 
processor 30 arranges substantially the original version of the OFENDINGU image 
saved at frame memories 20 and 24, respectively, and an image (align). This purpose 
is investigating correspondence relation with the sample of the corresponding image 
Wi with which Sample I and the water mark of an original image are attached, and 
the codeword multiplier's is added. 
[0031] 

This registration processing is explained using drawing 3 . Drawing 3 compares 
OFENDINGU version W of the original image I and the image to which the water 
mark was given, and is shown. As shown in drawing 3 , OFENDINGU version W of 
the image to which the water mark was given has offset to the original image, and 
this offset may originate in the relative visual field of a camera that the OFENDINGU 
version of the image to which the water mark was given was generated. 
[0032] 

In order to reproduce the expression of a codeword multiplier, it is necessary to 
subtract the right sample of an original image from OFENDINGU version W of the 
image to which the water mark was given. Two images are arranged for this 
processing. As shown in drawing 3 , registered image W" has the boundary region 
(peripheral area) PA which contains in an original image the part not existing. 
[0033] 

By other examples, when an OFENDINGU version downloads, for example from the 
Internet, correspondence relation with the version I of an original image may already 
be in **, and, in such a case, it is not necessary to use the registration processor 30 
with OFENDINGU image W. Then, this detection image processing system is 
equipped with the alternative-channel 32 for supplying directly the image to which 
the water mark was given to the playback processor 40. 
[0034] 

Registered image W" is supplied to the playback processor 40. The copy of the 
original image I is also supplied to the playback processor 40 through the 2nd 
channel 44. Image W" and the original image I which were registered are changed 
into a DCT field by the DOT processor 46. Next, as shown in the following formulas, 
presumed codeword X' is computed by subtracting sample V of the DCT field of the 
image to which the water mark was given from the sample V of the DCT field of an 
original image. 



g ID=000003 



Therefore, the playback processor 40 outputs the estimate of the multiplier of the 
codeword which should be identified through the connection channel 50. Reproduced 
codeword X* is supplied to the 1st input terminal of correlator 52. The codeword Xi 
generated with the codeword generation vessel 54 is supplied to the 2nd input 
terminal of correlator 52. The codeword generation machine 54 generates the group 
of all possible codewords using the predetermined seed value which identifies to a 
proper the codeword read from memory 58 like the above-mentioned discernment 
codeword generation machine 8. 
[0035] 

Correlator 52 generates the similar value sim of n pieces (i). In one example, the 
similar value sim (i) is computed by searching for the correlation based on the 
following formulas. 
[0036] 

[Equation 1] 

[g ID=000004 



[0037] 

Each of the similar value sim of n pieces (i) is supplied to a detector 60. and a 
detector 60 analyzes the similar value sim of n possible codewords (i) which is alike, 
respectively and receives. The relation between the example of the similar value sim 
(i) generated by correlator 52 and the threshold TH of each possible codeword is 
shown in drawing 4 . As shown in drawing 4 , two codewords 2001 and 12345 are 
over the threshold TH. For this reason, a detector 60 judges with the OFENDINGU 
image having been created from the version of the image to which the water mark 
corresponding to a codeword 2001 and a codeword 12345 was given. Therefore, in 
this example, the height of the threshold TH which guarantees incorrect detection 
probability can be set up based on the incorrect detection probability (false positive 



probability) determined with the magnitude of the population which is 10 million, and 
water mark reinforcement (watermarking strength). By the example shown in drawing 
4 , when the similar value generated by correlator 52 is over the threshold, it has 
this incorrect detection probability, the addressee of the image to which this water 
mark was given performs a malfeasance, and it is judged that it participated in 
creation of the OFENDINGU version Wi of the image to which the water mark was 
given. 
[0038] 

Hereafter, the water mark system feature and advantage which are shown in drawing 

1 and drawing 2 are explained. 

[0039] 

Registration 

The processing which arranges the OFENDINGU version of the image to which the 
water mark was given, and the copy of an original image includes the processing 
which investigates correlation with the sample of an original image, and the sample 
of the image to which the water mark was given. This correlation processing is 
performed by shifting each sample of an image by different shift amount. This 
processing is explained using drawing 5 . Drawing 5 A shows the discrete sample of 
an original image, and drawing 5 B shows the discrete sample of OFENDINGU image 
W to which the water mark was given. As shown in drawing 5 A and drawing 5 B, the 
time difference between each sample is dt which becomes settled with a sampling 
rate. The group of each sample of these images is shifted and the result of having 
made the discrete sample correlating is shown in drawing 5 C. 
[0040] — ~" 

As shown in drawing 5 C, in the shift between the 6th sample and the 7th sample, 
the correlation peak is the highest. In addition, as the continuous curve CL which 
connects between samples shows, one between the 6th sample and the 7th sample 
has the actual peak shift between the original image I and OFENDINGU image W to 
which the water mark was given. 
[0041] 

In a desirable example, the registration processor 30 detects the 2nd more precise 
location to this 1st registration location after detection of the 1st registration 
location. For this purpose, the registration processor 30 performs actuation as 
shown in drawing 6 . Drawing 6 A and drawing 6 B show the original image I and 
OFENDINGU image W to which the water mark was given, and the exaggerated 
sampling of these images is carried out with the twice as many sampling rate as this. 
Therefore, the time difference between continuous samples is dt/2. The peak value 
of correlation between the exaggerated sampling versions of OFENDINGU image W 
to which the original image I and the water mark were given is in the location of the 
12th sample, and this location is carrying out **** correspondence in the location of 
the peak of a correlation output value so that drawing 6 C may show. Thus, the 
registration processor 30 can perform [ rather than ] precise registration to two 



images by performing 2nd registration processing to the exaggerated sampling 
version of OFENDINGU image W to which the original image I and the water mark 
were given. 
[0042] 

The further advantage using the registration processor 30 shown in drawing 2 is 
explained using drawing 7 . Drawing 7 is drawing showing registered-image W" 
created by the processing explained with reference to drawing 3 as compared with 
an original image. OFENDINGU image W" to which the water mark was given — in 
order to raise the probability for an inner codeword to be detectable, the part not 
existing is permuted by the original image in the image to which the water mark was 
given shown as a boundary region PA by the field where an original image 
corresponds, the difference between the samples of the OFENDINGU image to 
which, as for this processing, the water mark was given with the sample of an 
original image — when the absolute value sum is compared and this value is over 
the predetermined threshold, it is carried out by transposing the sample of an 
OFENDINGU image to the sample to which an original image corresponds simply. 
Thereby, the detection processing which correlator 52 and a detector 60 collaborate 
and perform improves remarkably. When the boundary region PA of the image with 
which the water mark not existing was temporarily given to the original image is used 
for playback of a codeword multiplier, these multipliers do not have a correlation in 
the version by which the codeword was reproduced. These multipliers will generate a 
big value and will become a serious noise in the similar value sim (i) which is total of 
a correlation value. For this reason, in a detector 60, the codeword exceeding a 
threshold TH is detected and the probability that a right codeword can be specified 
falls. On the other hand, the part of an OFENDINGU image is permuted by the part 
to which an original image corresponds as mentioned above, and things can perform 
lowering a overlooking probability (false negative probability) by setting a 
corresponding correlation term as zero effectively. 
[0043] 

Codeword generation 

By generating the seed value of the random number used in order to generate a 
codeword from a source image sample, the engine performance of the example of 
this invention shown in drawing 1 and drawing 2 can be raised further. This 
processing analyzes the DOT multiplier of the image which should attach a water 
mark, and is realized by generating the seed value used from these DCT multipliers 
in order to generate a codeword. The "secure hash algorithm 1 (secure hashing 
algorithm 1:sha-1)" of the common knowledge for for example, this contractor can 
be used for this processing. This algorithm is specified to ANSI Standaards (ANSIx 
9.30-2). This algorithm is indicated by A Jay Menezes (A. J.Menezes) work "an 
application cryptography handbook (Handbook of applied cryptography)." Thereby, a 
coded-image processor and a detection image processing system can generate and 
judge the seed value of a random number from a DCT multiplier. 



[0044] 

Other examples of application 

In addition to the projector and web server which were mentioned above, the coded 
data processor of a water mark system is applicable to other applications. For 
example, this invention can receive a signal from a communication device, and can 
apply it also to the receiver/decoder which gives a water mark to information by 
introducing a codeword into this received signal. For example, a set top box receives 
television and a video signal from the "head end" device or multicast device of 
broadcast. In such an example of application, a coded data processor constitutes a 
part of set top box, and in case it receives and decodes a signal, it introduces a 
water mark codeword into a video signal. Setting in one example, this water mark 
codeword specifies the set top box which received and decoded the video signal as 
a proper. 
[0045] 

Furthermore; this invention is applicable also to the digital cinema receiver which 
receives digital cinema data (digital cinema film) from a satellite. This digital cinema 
receiver receives the signal showing a digital cinema, decodes this signal, and 
reproduces a digital cinema. This receiver is equipped with the coded data processor 
which introduces a water mark codeword into the decoded movie signal. A water 
mark codeword specifies the digital cinema receiver which received for example, 
digital cinema data as a proper. 
[0046] 

Furthermore, this invention is applicable to a digital camera or a camcorder equipped 
with memory and a memory controller etc. In this example of application, the coded 
data processor concerning this invention introduces the water mark codeword 
memorized by memory into the video signal photoed with the digital camera etc. In 
this example of application, the codeword is beforehand memorized by memory, 
therefore the coded data processor is not equipped with the codeword generation 
machine. The codeword memorized by memory is embedded under control of a 
memory controller at a video signal, and, thereby, specifies a video signal as a false 
proper target (quasi-uniquely) peculiar. 
[0047] 

In the further example, the coded data processor based on this invention embeds a 
series of water mark codewords according to an individual at each of the frame of 
the digital image from which the plurality which constitutes a continuous image or a 
continuous animation differs. These codewords may have relevance mutually and 
can identify now the image corresponding to each frame according to an individual 
by these codewords. 
[0048] 

The further various side faces and descriptions of this invention are defined in the 
attached claim. The gestalt of operation mentioned above can be changed variously, 
without deviating from this claim. 



[Brief Description of the Drawings] 

[Drawing 1] It is the block diagram showing the configuration of a coded-image 
processor. 

[Drawing 2] It is the block diagram showing the configuration of a detection image 
processing system. 

[Drawing 3] Drawing 3 A shows an original image, drawing 3 B shows the image to 
which the water mark was given, and drawing 3 C is drawing showing the registered 
image. 

[Drawing 4] It is the graphical representation showing the example of the correlation 
result about each codeword of the group of the codeword of N individual. 
[Drawing 5] Drawing 5 A is a graphical representation corresponding to the sample 
of the original image I, drawing 5 B is a graphical representation corresponding to 
image W to which the water mark was given, and drawing 5 C is the graphical 
representation showing the correlation result for every discrete sample shift of an 
original image and the image to which the water mark was given. 
[Drawing 6] Drawing 6 A is a graphical representation corresponding to the version 
by which the exaggerated sampling of the original image I was carried out, drawing 6 
B is a graphical representation corresponding to the version by which the 
exaggerated sampling of image W to which the water mark was given was carried 
out, and drawing 6 C is the graphical representation showing the correlation result 
for every discrete sample shift of the original image by which the exaggerated 
sampling was carried out, and the image to which the water mark was given. 
[Drawing 7] It is drawing explaining pretreatment of the registered image which 
permutes the part which does not exist in the original image in the image to which 
the water mark was given by the part to which an original image corresponds. 
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* IE rT & £ f? r> Tz=L-4f-C $> 5 LW&LT L £ 5 fiS^ ( » 4ft it * : f a 1 s e po s 
i t i ve probab i 1 i ty) tt , ^ tg & © 9 <£ < L ft < T 12 & <E> & U „ 

[ 0 0 0 8 ] 

*m¥rWm 5 6 6 4 0 1 8 ^ f2 < ?f 'J 7J^> (f-l;|£|ffl«|[Ht53 
- K V — F & Z ft f& 2 n ft i? ? Jl V * — ? ^ — ? £ ft ? <y # — ? ^ - ^ > # ^ m % m 

«^*nTi>5^*-^"7-i?oaii*ff a • * • * n -a- -r (d i s c 

re te Cos ine Trans f o rm : ST. D C T t l> 5 . ) ® Id 3£ $ f -5 
. ry^;^*-^?-?|J, IE SI # *i £ W L . 5 > L t«|tc!)jii>6ijsg 

ft T U» £ . DCTl«ICiHT, *tlfn*DCTffSl:»«t4ft3-|!7-l«ffSt*« 

* fin a n * . ^niciits jit^s 1 998^7^270, m i Ti>6ifT2nfe, 
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x -f • + 'J 7 > (J. Ki 1 ian) , 17 • f -f - • H h> ( F . T. Le i g h 

t on) m , I 3 )l — iS a > 7 9 v 9 \Ztt ? & 7* V ? )l V * — 9 — 9 V) & !& (Re s i 

stance of Digital Watermarks to Collusio 

n A t t a c k s) J \Z « , 7 9 y V £ Bft < It & © Z\ © >7 * - $ 7 - * > V & 9 © M 

[ 0 0 0 9 ] 

*^Snfcn-ya > i*i # £ T 5 1 o&±©F!)?5£©3- F 9 - F © iifl £ SO "T £ & ffi ^ 

$ n fc a* - j? 3 > © > y )v & . wists^ - f ? - Fgs^e^snfctu yt^vf 

igflJ, SIC, t'J-/t)l''7f l J7^7'ffA©-!f>^il't. — ^attfStt 

^ - F v _ F££$;-r-5S£7 p o-tr-y+r£. ffi £ © 3 - h'9 - K©ai:*tt5§3 - F 7 

- h' I: O U T , S£3— F££j*Snfc3 — F7— F<fc««HS-B:a£<hK:«fc0ffl 
^MSr^fiK-r-SffiM^P-fe-y-y-i, Bf«©H«*iH*.S3 — F "7 - F © ffi W « * -3H» T 

. loa±©3-H7-H5^ffit5«tii7 1 nt7tftSIx.^. 20 
[0010] 

#3£BJ]©SfS2©fiiJ®<hLT. # 98 tt , *US^;l^5"U7Jl/7-f^A©:3kr-f;:fi) f r5g© 

7 ^ 7 < 5" A © '> ft < ifc 1 O©^* — :?7-?;&*tt£nfcA->>3 >Sr^rit-r*«F^Yk 
^-^fflSgg^ffi^-T^o f ^ftr-i'MlSIli- 3 - F «7 — H©0f5t©ia*>eifi* 
03-K7-H«»£tt53-F7-F*t)$tS3-K7-h-tlSS*fii5. JElc 
. ft^flS^-^MfflgBte, =*- U ytiPTT U TJWT-f ^ A © t" -5 It ft © > 7° JMC 
8- 3 - F 7 - F « ft S IS L , 0*-?7-^'#SnfcA--/3 >*4*t5ff§ft^ 
Dty*SiA4. a-h*7-H4«gli, ME&£lft£J«8g&fl;*.S. 

gg , 3-K7-HCH#»ciaa#ite.nT^s->-Kffl{c«t-3T^iHa»*f«s*«!j»i 30 

ffc L , »<H&R£J*»KJ:oT£lSSn;fcK«*»e3 - K7- F £ £ tfc f 5 . 
[0011] 

# f£ 93 . *1SS8 5 6 6 4 0 1 8 mz ffl 3 tlT H -5 «t O tz , ^>^A(C^^L^:^ 

»<Ha**J*»*ffl^>-S. giatt)SStty-h*ffl*ffli>- -> - F ffl « , K (H SL ft £ J* 
S*<£J5)cT-5ftffl©->-^->X**^T'5. x - F ffi , i © -> - F ffl 6 £ fiK 2 tt 3 

- F "7 — F # ffl » & * n fc >7 * - * T - f ** ft £ tl V =f U 7 ;U 7 -i J- A © A* - i> 3 >(C 
&m V *> ftT Z> . L it o T , C © -> — FillCtO, -7 * — ^-7-^a<#£*l 
fcvf 'J7;P7^f >S*|l:l*St5uia«T*5. 40 

[0012] 

*^BJ3tcS-^<^tti7 i -^5n.a^fi«, S&7°p-tr-y-tf-£{ft*.<3. SSIt'p t y t lei 0 
. ^tU5 :J -^«affl^fi©ttffiA I 3g^ii5<7i^„ 7fU7^7^fA07*-5'7-^)5J# 
^ nfc/\'-y 3 / J?f 'J 7 Jl/ 7 -f t - A © ^" U ytJl-3 ¥ — lZttl£2-&T&m-rZ>Z\£lZ 
<fc 9 , 3-F7— F©#&«:&tiiT£2>ffl4s*iiS<&0, iiS Lj|$ (f a 1 s e ne 
gat ive probabi 1 i ty) STtf 5 i ii^ti. d *1 . <7 * — ^ T — 
i7 tit £ nfcV 7- 'J 7 ;W 7 -f 7- A © -9" > ^ ^ tt , t'Jyt^Vf 'J7^7-f fACOf >7° 
;H£ *# Jfc T * "J fl6 ft *« * H » . 3 - F 7 - H*H4T*4»*a«*<a:5*6T»5. 
[0013] 

* 5! Ifl © » * L ^ ft <fc #J (C 43 t> T « . 3 - F 7 - F © -> - F ffl H . t'JytftTf 'J7A 50 
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t -f t a © -tr > rf ;u © m& <=> mm 3 ft s . cniuo, § ^ - k -7 - k tc *f -r s -> - k <a 

[0014] 

# 56 BJ3 © M ft & ffiij M & r/ & ® te . »#»«*otBl:fiUTtiaftTl>4. 
[0015] 

[3S9J©fliiS©flj*Jg] 

KT. *»HO*lO»16tf tII»©««CHI*tTIIlWt*. k* :r * Si & £ BE ft 

n tf-ra»^ft^T5. § n tf - tc , ;ifts©3.--!f©5l3© 
1 A K #J 0 3 T 6 ft fz 3 tT - * IS gij -T « tb © §S& B"J 3 - H »7 - F ( i d e n t i f i c a 
tion code word) ^ttUSttS. 
[0016] 

tf 5* 3f H * tt , t-/?J^ - K>7_ HSaa&iitrcttcttJfilllSft^vxUy^OD-ft 

# #j t $> s „ '3 - P7 - K&a*)itjrt{c«fco«gi$ft-5v^UT;utt. t* ^ * « & © 

[0017] 

H 1 tt , t'J t-l:USij3-K7 - KS*At5»f (e 

ncoding image processing apparatus) © ^ 0<J 

1 tc £ ft £ 0 £ © :* ij Jim tik \t , >?t-^7-!?Ai#^rifc1IS[0D3t;-i:LT 
IS ¥ 2 ft 3 (reproduce) fc © T * D . g- 3 hf — tc « @ *r © i& 3U 3 — K "7 — K 

# ft" £ ft £ . ^ U ^- ;H® # , DCT7 p n-tr-yD-2tC«iSi&$ft > DCTynty1f2tt 

SSrSST. ^ n I; i 0 , DCT^Dt7lt2tt, DCT^IItVS4f£t5„ 
[0018] 

u 7 ;u t ft o t t> «t t» „ ) s#ij«-r*(i«-y->^;i.sii-rt)CD<fr*. ■•*■>:/ ;mi . a 

[0019] 

# ft y D -fc -y U- 4 K fit . »9J3- r J «7-K±Ji8»8*»6«»Jzi-H7-K'b«»SftTlr» 
-5 . 

[ 0 0 2 0 ] 

i9J3-h'7-K4fiSS8Ctt, ft ft © -> - K m (seed) 4« (K S ft s . & -> - K « 
tt . *ft-€ f ft»*"r*«8iJa-K'7-rS01t>*4fiR-rs>t«6K:«[ffl3fta. £ « 3 ft fc 

f**f+Sft*:iiI«*«*BfiaftS. £g gij 3 - K -7 - K £ J* §§ 8 « , g, t 4 sES 5 I A 5 

. ai(!aa»5fefiKSfi, # j£ © at 3 — h*7- H*^^-rsfc»©n — k «7 — k a* it & £ sk 

» * U l» * # « 4s u> t tt . 3-h*7-H«*li, iE«»*Jc*^HT*j«Sft* 
. * * , ^CftAT, 3 - H «7 - K * R tt , »(HSa.ft±J«»*SJ«Ift-r*fc*»=ffl^<& 
FIKJS^HT. ^«65t«6Tt)«t^. L 76* o T . «■ * 9J 3 - H <7 - K tt , *f « f 
-Sv- — h'iM#ftL, # -> - Ffitt, ^*'J12»Cie*SftT^*. -T ft to % , IS gij 3 - 
K7 - KX 1 *4sJt5fc»lC. i'-His e'e d | t/tU 1 2 * 6«*a d © -> 
-KMseed, * ffl n r . «SUa-K7-h'£j«ig8rt©»&a»£]*SSfflJ«ftTS 

o 

[ 0 0 2 1 ] 

« T <Z> K W T tt * t'J^t;Hft©DCTA-y 3 >$Vt$t e £ C T , 

V = { V j } = { v x , v ? , v 3 , v 4 , v K } 
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T&D, v, « , It0DCTiS(Tfe5. ftfl CD ft 4* & t,* T . v, H , H fll CD > 

[ 0 0 2 2 ] 

& 1$ S'J 3 - F "7 - K X 1 \t . BlT©J:^l:, ni©3 - h*7- HSRA^ifiESntHi 

o 

X , = {x' j } = {x' 1> X ' 2 ■ X ' 3 , X ' 4 , X' n } 

:-F7-F«»(5*ntt, *ij^^;ni«kv<ou->^;u»cfc*tisr*. fc , & & cd & 

lr» . 10 

[ 0 0 2 3 ] 

fit, i # B <D IS S'J a - F -7 - F X 1 SidEtia - H 7 - K «8k©'5i' h;Hl, 7 + 
>*JH46^LTI>3-J'4l:*«3n5. X > a - ^ 4 IS , Si* V tC IS S'J 3 - F 7 
-FX 1 6ftftlt5u tfcj; 0. ^t-i'V-^iWSnfciftW, $r^fiS;-r^>. 

^-^v-^jjtfd-anfcinftw, a* £ £ n s . 
w , = v + x 1 

W [ = V t + X ' i , V 2 +x' 2 . V3+x' 3) V 4 +x' 4> • • • , V n +X* 
n 

0 l icSti^l:, V * - 9 - irtftf 2 tiltmfovf t « . x>n-^4tcj;t3^fi£^n 20 

fcI«*lDCT^»t?)i£DCTyat7ltl 8 iCtot, f D C T 3 tlfc Z. 

[ 0 0 2 4 ] 

LfcilioT, 0 1 I: S t ± 5 C - X>3-y4fr<=,te, ^^-^V-^At^^tlfciS^cD 
ffl^iU^^tlS. f-?7-HSl*2 0 1^7 httS,!:, — ^ 75 <@ CD US S'J 3 - F 7 - F 
ffll751Kt5:t*iTt, :* 'J 3; ;U B & *t L T , — ^F7T«cO^*-^V-i'A*# 
3 n A - iS a > W , £ £ JSfc T Z> Z. t T * 5 . 
[ 0 0 2 5 ] 

£ CD 31 gij n - F «7 - F \z «fc D , BftlO'Jt-i'^-i'A^Sn&ne-Wi « fl jS<J Ml 
B>J -T -5 d <h T £ -5 ** , fffi © ft * #J tC & l» T « . ± $ <D 2 0 t* h tC «fc D , W $ ft T 5 s — 30 
^«rj§^^i:*i-e^-5. Lfc^oT, ^TlCifcHfl-rsj^ic. 1$ gij a - F 7 - F £ ji T 
•S>/t*JC<seffl$n^2 0 k* MS, M«V|*lTf-^ : &ll)fc*CD2 0 k >y hffl^-fn- 

[ 0 0 2 6 ] 

^ 1 est, ^^-^v-^/dM^^nfcili^^^fiKT^^^fbiliSs^aSHta, * 3B 91 a* 

ii « £ n 5 « * & g & s v ^ u * * ^ t , «*i&sn*. . nmt 

F3ti5i*i:HSf ®n - H7 - ^ifASn, :®itro3-K7-Fi:J;0 1 ^ -7 
>a- Ksnfcitcsflitsacttitii-Si: t*«T*4. 40 

[ 0 0 2 7 ] 

ffi © M ffl « T tt , ft«<ftHftffia&Bi;t. x ^ ^ ;Hi* 9 « ( d i g i t a l c i nem 
a p r o j e c t o r) <D—%&iiLTm?>-&2Ltl. & 8U 3 — F "7 — F tt , #J l£ l& Hi tg 
k: is n T , BfeBStt^TSIRK:, iftttftlosns. uCoasija-h-7-H:it3, b* Bi 

tifcBfc^Srlt^LTWSnfcjSWISahr-fc^SnsMlMii-KC-Htit), ^ cd fg We 
figafcf-*t^fig$nfeS*¥«St;?*i®tl*#5t-r^c:i:**T^^>. -77 . >7 * - 9 V - ^ 
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[ 0 0 2 8 ] 
4ft m o ± y? 

B 2 , <5*-*-?->7tftt$tirz*7ji>y : '(>>fmm ( o f fend i ng mar 
ked image) rtfcaftj&SftTHSlOttiOa-K^-KtfcfflfSfcUBaai 
SSM (detecting image processing apparatus 
) co#t(5)c£;^T:/D-;/y'IIlT-&-5. S S H A « , H2tC^-rifttnIii«5!ia^Ml± t B 

m<D*73i>7 : j -r fc> % zi l owiran - K "7 — k s at jm -r s 

[ 0 0 2 9 ] 

a *i . 7l/-A/t 'j 2 o i:«S3ti5. -co&ffiHMg^atc&tts&ffifflSte. n 
tO^'J^t^A-^a^S^Sttiftft, 7 V - A * * 'J 2 4 \t , ffl * CO * >J ^ 7- 
;U A* - 3 >^«SSnTl>5. ^-^v-^rtSfl-SnfciSfccD^^x^T^ > y a _ 
^a>W RtfMWt'JytAA'-y'aXi, ^ tl ? tl <@ SU CO « igg ^ * > * ^ 2 6 . 2 
8 £ ^ L T . S^7*nir- y -9- (regi s t rat ion processor) 30 (C 

mm s n & o 

[ 0 0 3 0 ] 

± as © J: 3 K , ®^^^co3^-7x>7 ^ ^'>y/^*-v3>w• . V * - 5> ^? - ? *i ft a nt^m 
« W , cO-g!5^a^X«ifl^T^>^<i:{Cct0^fi)tatXfcpT^tt*i$.-5 o £ T , B 9J n - 
K7-KO«|iJ*S(5»Sft»l:. ii7-Dt7t301i, fftfh7l/-i/tiJ20 
. 2 4^^^anTU«>^-7'x>5 ; -C >^iU^ ( i:Hi^C0^-'J )V A — 'J 3 

< a 1 ign) „ dcogftti, * U :x ;i/ H ffc CO +r > ;/ ;i, 1 £ , r> * _ y v _ ^ 

3- K7-K«**»#*snTt>4»*t5i«w 1 <o > 7 <d n & w & 

[ 0 0 3 1 ] 

:«)SB«i«B3SlHTRBt«. 0 3tt, * V i? 7- KM i* I £ <7 * - * T - ? ft 
Snfcl«ffl*7i>f^ >^A'-y 3 >W t*tt«LTSLTH5. H 3 \Z Ok T «fc 5 
iz > ^1--^^-^* { #anfcili^C0^-7x>^^>y/X-^3>W' tt , t'JytAI 
it»lTt7ty MtLTSO, C © t 7 t y , ^*-^V-^75t#^n^iii« 

co * 7 x > 7 s * > ^ a - ->* 3 > BKsnfc*/5©ffi»«fta»tieH-r*?riiitt*«* 
5 . 

[ 0 0 3 2 ] 

3-K"7-H«*©*S*W4-r*fc«)»C, ■7^-^V-i7;6t#anfcffii«C0^7x>^ 
-f > f A - V 3 > W d^tU yt^BtcoiEL^^^^^SMStS^I/Oii&S. z. CO 

^acofesbtc. 2^coiB^^}ifrA?,n?». h 3 ic'^-r «k 5 ic . s&atifciuifcw" a, * 

U^7-;Hii«C«#ffiL^^fi|5^Sr^trJlia®« (pe r i phe ra 1 area) P 
[ 0 0 3 3 ] 

ffl CO * m T 11 , 0>J A « < > * - * y h^£*7x>7^ > y A* - 2; 3 > # ^ ■? > n - K 
atifc*^*. 'T7i>fOi'i»w' t U k * 'J ^- ;p a m co a- - s> 3 > 1 t co *f j£ 

M«**W*»T**Ct*t*0. £ © «k 3 * £ , ai7"Dty*306ttlt«*Slift 
to . ^ C T . .rco&jiJH&SliggBte, -7*-^v-i7*t#$tl7cH^^S^^D-fe^-tr 
4 0 trfiS«*&-rSfeJ6C0-r^#«)^^v>*^3 2 SIXTHS. 
[ 0 0 3 4 ] 

H3«fti*W" tt . St7nt7*4 OCftl&sn^. B47"nt7t40l:li, m 
W R * ij $; ;|, h £ 1 ( j , DCT7Dt^46l:ioT, DCTf ^IC^i^^S 
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-fx' a* * m s n s . 

x* =v' -v 

= v' i-vj, v* 2 _v 2' v ' 3 _v 3» v * 4 _v 4» * * *» v 
' n-v n 

= x* i, x' 2 » x ' 3* x ' 4» * * *» x ' n 

— K<0««CO«l«IISm*'r*. W£Sftfc3 — H? — FX* tt . *BH§gg5 2tf>fglWA 

T4fi£3nt3 - F'7 - KX 1 A«ft^Snt^5. 3 — K-7-h*:£fijcS§5 4te. ± #i <£> 18 
»l3-H9-H4)«B8t)lil:, ;* ^ 'J 5 Bjfc&KJUtil/fca-P^-FfcHWlcaM 

•r * a? * <& -> — Kitsffli/iT±T©piii6«tii — h*7- Koas^rtr*. 

[ 0 0 3 5 ] 

tl B§ gg 5 2 . nf@CO?S{Kfiis im (i) £ £ T £ . — & fls « K * 1^ T tt . SI (H fit s i 
m (i) tt , JKT«)SCK:a^<fflH****itKJ:OJ|CtHSns. 

[ 0 0 3 6 ] 

[ IS 1 ] 

X i* x . x , i*a:'i+ ^2*.x: , 2+a: i 3*JC , 3+-..+^*^ , ii 20 
sim(i)=— r = . — — 

[ 0 0 3 7 ] 

n fl 0 S & tt s im (i) Offlfllli, &ttigg6 0fC#t:ifcS;*ft5. f IT, «ttiS?6 0 
tt . nflffliililifea-F^-KO^n^ncWtSSiHls im (i) £ # #r "T £ . *§ US 
S5 2l:J;oT4^^neSitts im (i) <D * # « 4: . pJ&fc&n-H^-FOHffi 
THiK>M^<£ia4(C^-roia4tc:^f<i;5{C, 2 0 0 1 . 1234 

5*«EJ3tTHSIATl^. Z (Dittb. & Hi & 6 0 , a-K^-r^OOl&tfa-J* 30 
•7 — H 1 2 3 4 SfC^JfoTS'}* — ^v — ?Afft$nfeHfroA'-y3>^6t7i>r 
-f>^®{fc3&»fPJs3cSnfc4:f»Jft , rS. l/ft*«t)T, CD ft # i5 (,> T « , — ^ 77 T fe, •& 
S*a©^:€?^^cfcOSi5£^tl^^«lttl«g* (fa 1 se pos i t ive prob 
abi 1 i ty) £ , V * — ^V — ^ 3£ a (watermarking s t rengt 
h) tl:Sdl)T, ^«IIU56^Sr«iE-rSia8fiTH(Offi$Srl9:^-r'5C<i:75^T^-5o 124 
tC f ft # 01 T « , tl Hi g§ 5 2i;ioTt^SnfcS(HI*!Htt?;Ix.T^5i^. Z. CO 

# - $ _ /7 fvf 2 ft fcBi ft * y x > 5 s 4 > if A* - if a > W 1 ©f£(fclCW#L£<h*iJWr 
£ ft -5 . 

[ 0 0 3 8 ] 40 
J£A T . El 2 K T "2 * — * V — ^->^^A©if#«RtffiJ^<&lttWrS. 

[ 0 0 3 9 ] 

mm. 

v * - ? - 7 & t< n. tzw m <d * y * > 7 * > tr n-is b > t > * u yt;n«ffla tf 

-t&ttJASifflgW:, tUvt;i'il©it>7"Jl't, r7* — ^"T — ?A<tt-£ft; l i:iIi^fe<£>■t)- 
>:/;^£:<Z)ffiliS£lB^34!!l^l£^tf < , £ <Z> *§ HI M JI « , ■ •©#-i»->:7;H£»fc*5':7 h 
iTx7 hStT*ff Stl5. £©»3*BI5£fl|V>Tl89!-r*. 15AS, ^ 'J is i- )\/ 

mm.<nm.Wi j * > y° >v & mi, , m 5 b « . ? * - * v — i7^#^ftfc^7x>5 i ^>^iiift 
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[ 0 0 4 0 ] 

I5ci:iti^:, m 6 +)• > 7 )i ts 7 -y- > 7 ;u © p B i © -> 7 h tc 43 1> t , ta M tf — 2? 

;na ft 1 if^--i'7-?i!(tsnfc*7i>f^ > y b & w <toom«o*B{oDtf-^>/ 
7 h a . m 6 -v- > 7° )i tm 7 v > y° )i <nm<D-~ $> % . 

C 0 0 4 1 ] 

ffiLH*ft«t*UTtt. S^^D-fe-y^3 0tt. i 1 ©Igfii^ttuci, © !& 
1 ©«»(£« £#UT«fcBtt«fcS62©ffiM*ttUi-r*. ;ffl|«T, SH^Dtyf 3 
0 tt , EI6tC^-r<t'5^1»if^SrfT-5. 16 BIJ, t U vt;H» I <!: ^ * - ^ 

7-?i«ftsnft*7x>f oymw t * * ut*s 0 . c * s 2{g©-y- 

B# ffl ^ « , d t/2t*5. 0 6 C » A» 5 J; 5 l: , ^Uv^^Bftli^-^V- 
^75i#$nfe5f7x>^^ >^I|IW' © :* - A* -y- > ^ >J >{Trt-J>s > Pel © t@ M © tr - 

2Mi . mi 2it>y;UOTfiiBtca5o. © ft s tt > ffiWa7j«©hr-*©tir«K:«f*2# 
M$nfe^-7x>xi' > ft w © * - /\- -y- > u > y a* — 3 > i: ^ 1 1 1 2 ©as 

[ 0 0 4 2 ] 

7 tt . 03£#!lLTi&lWLfcfflgfcJ;Of£fi!c3nfc»©BftW'' **U3?^;HB«tJt 
«LT^f|g|T&3„ ^*-5'V-i7*t#$tlfc7^7x>7 ^ ^'>^iilftW' , f*| © n — K "7 

-K*4fttar€r***sas«>sfca6»c, iiampAii/TSsnTus. 
* ** # $ n it m ft tc * «• * * 'j ^ ± & m ft k a # ft u a t» as # a , * u y- ;ns ft © # « 
t5®ii:J;oTi«^ti5. :©ilia, u y- ;u b ft © -y- > y ^ £ > r> ^ _ v _ 
^A I W$nfct7i>r^ >^Bft©-y->^";i.«J:©W©||^«6*fffl?D^jt«fL, £ © fit ri* 

6oa«t6«LT*ff-r**ttj8i3j&t#i,<ffl±-r*. (rh . t'j^t;n»i:ii#ftL& 
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1 Title of Invention 

DATA PROrFSSING APPARATUS AND METHOD 

2 C 1 a ins 

1 . A detecting data processing apparatus operable to identify one or more 
of a predetermined set of code words present in a marked version of an original 
material item, said marked version having been formed by combining each of a 
plurality of samples of said original material item with one of a corresponding plurality 
of code word coefficients; said apparatus comprising 

a registering processor operable to associate samples of said marked version of 
said material item with corresponding samples from said original material item to 
which corresponding code word coefficients may have been combined, 

a recovery processor operable to generate a recovered code word by comparing 
corresponding samples of said original material item with said samples of said marked 
material version, 

a correlation processor operable to generate, for each of said code words in said 
predetermined set of code words a correlation value by correlating the recovered code 
word with each of the generated code words, and 

a detection processor operable to detect said one or more code words from the 
correlation value for the code word exceeding a predetermined threshold, 

2. A detecting data processing apparatus as claimed in Claim 1 , wherein 
said registering processor is operable 

to form a representation of a correlation of the samples of said original material 
item and the samples of said marked version, for each of a plurality of respective shifts 
of said original material item with respect to said marked version of said material item, 
and 

to determine a first registration position of said original material item with 
respect to said marked material item, from the respective shift producing the highest 
correlation value, wherein said registering processor is operable 

to over sample said original material item and said marked version of said 
material item, 



(17) 



JP 2004-40751 A 2004. 2. 5 



to form said representation of the correlation of the over sampled versions of 
said original material item and said marked version, for a plurality of respective shifts 
with respect to said first registration position, and 

to determine a second registration position from the respect shift of said over- 
sampled versions having the highest correlation value. 

3. A detecting data processing apparatus as claimed in Claim 1 or 2, 
wherein said registration processor is operable 

to calculate a difference between each sample of said original materiaJ item and 
the corresponding sample of said marked copy of said material item with respect to 
said second registered position, 

to compare the difference with a pre-dctermined threshold and if said 
difference is greater than said threshold, to replace said samples of said registered 
marked material item with said samples of said original material item. 

4. A detecting data processing apparatus as claimed in any preceding 
Claim, wherein said correlation processor includes a code word generator operable to 
generate pseudo-random numbers from which said regenerated code word coefficients 
are formed, said pseudo-random numbers being generated from a seed value, said seed 
value being formed from the samples of said marked material item. 

5. A detecting data processing apparatus as claimed in any preceding 
Claim, wherein said code word has been introduced into said material item in the 
discrete cosine transform domain, said apparatus comprising 

a discrete cosine transform processor operable to transform said marked 
material item and said original material item into the discrete cosine transform domain, 
wherein said recovery processor is operable to generate said recovered code word by 
subtracting corresponding discrete cosine transform coefficients of said original 
material version from discrete cosine transform coefficients of said marked material 
version. 
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6. An encoding data processing apparatus for generating at least one 
marked version of an original item of materia] by introducing one of a predetermined 
set of code words into a copy of said original material item, said apparatus comprising, 

a code word generator operabJe to form said code word from said 
predetermined set of said code words having a plurality of code word coefficients, and 

an encoding processor operable to combine each of the code word coefficients 
with one of a corresponding plurality of samples from said original material item to 
form said marked version of said material item, wherein 

said code word is generated using a pseudo-random number generator 
initialised with a seed value uniquely associated with said code word, said code word 
coefficients being formed from numbers generated by said pseudo-random number 
generator. 

7. An encoding data processor according to Claim 6, comprising a code 
word generator operable to generate said seed value from the samples of said material 
item. 

8. An encoding data processing apparatus as claimed in Claim 6 or 7, 
comprising 

a discrete cosine transform processor operable to transform said material item 
into the discrete cosine transform domain, said material item in said discrete cosine 
transform domain being represented as a plurality of discrete cosine transform 
coefficients, wherein said encoding processor is operable to combine said code word 
with said material item by adding each of said code word coefficients to a 
corresponding one of said discrete cosine transform coefficients, and 

an inverse discrete cosine transform processor operable to form said marked 
copy of said material item by performing an inverse discrete cosine transform on said 
discrete cosine transform image to which said code word has been added by said 
encoding processor. 

9. A cinema projector including an encoding data processing apparatus 
according to Claim 6, 7 or 8, wherein said data processing apparatus is operable to 
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receive at least one of audio signals and image signals before reproduction, and to 
introduce a code word into said at least one of audio signals and image signals before 
reproduction. 

10. A web server operable to provide material items for downloading via 
the Internet, said web server including an encoding data processing apparatus 
according to Claim 6, 7 or 8, wherein said data processing apparatus is operable to 
receive material items and to introduce a code word into said material items before 
said material items are downloaded. 

11. A system for identifying the recipient of a material item, said system 
comprising 

an encoding data processor according to Claim 6, 7 or 8, operable to generate 
said marked material item by introducing a code word generated from a seed uniquely 
identifying said recipient, and 

a detecting data processor according to any of claims 1 to 6, operable to detect 
with a predetermined false positive probability the recipient by detecting the presence 
or absence of the code word in said material. 

12. A method of identifying one or more of a predetermined set of code 
words present in a marked version of an original material item, said marked version 
having been formed by combining each of a plurality of samples of a copy of said 
original material item with one of a corresponding plurality of code word coefficients, 
said method comprising 

associating samples of said version of said material item with corresponding 
samples from said original material item to which corresponding code word 
coefficients may have been added, 

generating a recovered code word by subtracting corresponding samples of said 
original material item from said samples of said marked material item, 

generating, for each of said plurality of code words, a correlation value by 
correlating the recovered code word with each of the plurality of code words, and 
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detecting said at least one code word from the correlation value for the code 
word exceeding a predetermined threshold. 

13. A method of generating at least one marked version of an original item 
of material by introducing one of a predetermined set of code words into a copy of said 
original material item, said method comprising, 

forming said code word from said predetermined set of said code words by 
from a plurality of code word coefficients, and 

combining each of the code word coefficients with a different one of a 
corresponding plurality of samples from said original material item, to form said 
marked material item, wherein said forming said code word comprises 

initialising a pseudo-random number generator in accordance with a seed value 
uniquely associated with said code word, and 

forming said code word coefficients from numbers generated by said pseudo- 
random number generator. 

14. A data signal representing a material item to which a code word has 
been added by the data processing apparatus according to any of Claims 6, 7 or 8. 

15. A data carrier having recorded thereon a data signal according to Claim 

14. 

16. A computer program providing computer executable instructions, 
which when loaded onto a data processor configures the data processor to operate as 
the detecting data processing apparatus according to any of Claims 1 to 5 or the 
encoding data processor according to any of Claims 6, 7 or 8. 



17. A computer program providing computer executable instructions, 
which when loaded on to a data processor causes the data processor to perform the 
method according to Claim 12 or 13. 
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18. A computer program product having a computer readable medium 
having recorded thereon information signals representative of the computer program 
claimed in any of Claims 16 or 17. 

19. A receiver operable to receive signals representative of material items, 
comprising 

an encoding data processing apparatus according to Claims 6, 7 or 8, operable 
to combine at least one code word with the received signals, said code word being 
provided to identify uniquely said received signals. 

20. A detecting or an encoding data processing apparatus as herein before 
described with reference to the accompanying drawings. 

21. A method of identifying at least one of a predetermined set of code 
words or a method of generating at least one marked copy of an original item of 
material as herein before described with reference to the accompanying drawings. 
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3 Detailed Description of Invention 

Field of Invention 

The present invention relates to encoding data processing apparatus and 
methods, which are arranged to embed code words into versions of material items. In 
some applications the code words are used to uniquely identify the material items. 

Correspondingly, the present invention also relates to data processing apparatus 
and methods operable to detect one or more code words, which may be present in a 
material item. 

Background of the Invention 

A process in which information is embedded in material for the purpose of 
identifying the material is referred to as watermarking. 

Identification code words are applied to versions of material items for the 
purpose of identifying the version of the material item. Watermarking can provide, 
therefore, a facility for identifying a recipient of a particular version of the material. 
As such, if the material is copied or used in a way, which is inconsistent with the 
wishes of the distributor of the material, the distributor can identify the material 
version from the identification code word and take appropriate action. 

In this description, an item of material, which is copied or used in a way, which 
is inconsistent with the wishes of the originator, owner, creator or distributor of the 
material, will be referred to for convenience as an offending item of material or 
offending material. 

The material could be any of video, audio, audio/video material, software 
programs, digital documents or any type of information bearing material. 

For a watermarking scheme to be successful, it should be as difficult as 
possible for the users to collude in order to mask or remove the identification code 
words. It should also be as difficult as possible for users to collude to alter the 
identification code word to the effect that one of the other users is falsely indicated as 
the perpetrator of an offending hem of material. Such an attempt by users to collude to 
either mask the code word or alter the code word to indicate another user is known as a 
collusion attack. 
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Any watermarking scheme should be arranged to make it difficult for users 
receiving copies of the same material to launch a successful collusion attack. A 
watermarking scheme should therefore with high probability identify a marked 
material item, which has been the subject of a collusion attack. This is achieved by 
identifying a code word recovered from the offending material. Conversely, there 
should be a low probability of not detecting a code word when a code word is present 
(false negative probability). In addition the probability of falsely detecting a user as 
guilty of taking part in a collusion attack, when this user has not taken part, should be 
as low as possible (false positive probability). 

US Patent Serial No. 5, 664, 018 discloses a watermarking process in which a 
plurality of copies of material items are marked with a digital watermark formed from 
a code word having a predetermined number of coefficients. The watermarked 
material item is for example an image. The apparatus for introducing the watermark 
transforms the image into the Discrete Cosine Transfonn (DCT) domain. The digital 
watermark is formed from a set of randomly distributed coefficients having a normal 
distribution. In the DCT domain each code word coefficient is added to a 
corresponding one of the DCT coefficients. The watermarked image is formed by 
performing an inverse DCT. A related publication entitled "Resistance of Digital 
Watermarks to Collusion Attacks", by J. Kilian, F. T. Leighton et al, published by 
MIT, July 27, 1998, provides a detailed mathematical analysis of this watermarking 
process to prove its resistance to attack. 
Summary of Invention 

According to an aspect of the present invention there is provided a detecting 
data processing apparatus operable to identify at least one of a predetermined set of 
code words present in a marked version of an original material item. The marked 
version is formed by combining each of a plurality of samples of the original material 
item with one of a corresponding plurality of code word coefficients. The detecting 
apparatus comprises a registering processor operable to associate samples of the 
marked version of the material item with corresponding samples from a copy of the 
original material item to which samples corresponding code word coefficients may 
have been added. The detecting processor also comprises a recovery processor 
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operable to generate a recovered code word by subtracting corresponding samples of 
the original material item from the samples of the marked material version, a 
correlation processor operable to generate, for each of the code words in the 
predetermined set of code words, a correlation value by correlating the recovered code 
word with each of the code words, and a detection processor operable to detect one or 
more code words from the correlation value for the code word exceeding a 
predetermined threshold. 

According to a second aspect of the invention there is provided an encoding 
data processing apparatus for generating at least one marked copy of an original item 
of material by introducing one of a predetermined set of code words into a copy of the 
original material item. The apparatus comprises a code word generator operable to 
form the code word from the predetermined set of the code words by generating a 
plurality of code word coefficients. The apparatus includes an encoding processor 
operable to combine each of the code word coefficients with one of a corresponding 
plurality of samples from the original material item to form the marked version of the 
material item. The code word generator includes a pseudo-random number generator. 
The code word generator is operable to initialise the pseudo-random number generator 
in accordance with a seed value uniquely associated with the code word, and to form 
the code word coefficients from numbers generated by the pseudo-random number 
generator. 

The present invention aims to provide a practical watermarking system, which 
utilises code words having coefficients which are randomly distributed as proposed as 
in US 5,664,018. The present invention utilises a pseudo-random number generator 
forming part of a detecting data processor and an encoding data processor. The 
random number uses a seed value, which determines the sequence of numbers, 
produced by the number generator. As such the seed value is uniquely associated with 
the watermarked copy in which the code word produced from the seed value is present. 
The seed value therefore provides a convenient facility for identifying the marked 
copy. 

The detection processor according to the present invention is provided with a 
registration processor. The registration processor provides a further advantage. By 
registering the marked copy of the material item with respect to the original copy of 
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the material item, the likelihood of detecting the presence of a code word will be 
improved, reducing the false negative probability. This is because the code word will 
be more likely to be recovered since the samples of the marked material item will be 
more likely to coiTespond with the samples of the original material item. 

In preferred embodiments the seed value of the code word is derived from the 
values of the samples of the original material item. An advantage is thereby provided 
because it is not necessary to communicate the seed value for each code word between 
the encoding and the detecting data processing apparatus. 

Various further aspects and features of the present invention are defined in the 
appended claims. 
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Description of Preferred Embodiments 
Watermarking System Overview 

An example embodiment of the present invention will now be described with 
reference to protecting video images. The number of users to which the video images 
are to be distributed determines the number of copies. To each copy an identification 
code word is added which identifies the copy assigned to one of the users. 

Video images are one example of material, which can be protected by 
embedding a digital code word. Other examples of material, which can be protected 
by embedding a code word, include software programs, digital documents, music, 
audio signals and any other information-bearing signal. 

An example of an encoding image processing apparatus, which is arranged to 
introduce an identification code word into a copy of an original image, is shown in 
Figure 1. An original image lis received from a source and stored in a frame store 1. 
This original image is to be reproduced as a plurality of water marked copies, each of 
which is marked with a uniquely identifiable code word. The original image is passed 
to a Discrete Cosine Transform (DCT) processor 2, which divides the image into 8x8 
pixel blocks and forms a DCT of each of the 8x8 pixel blocks. The DCT processor 2 
therefore forms a DCT transformed image V. 

In the following description the term "samples" will be used to refer to discrete 
samples from which an image (or indeed any other type of material) is comprised. The 
samples may be luminance samples of the image, which is otherwise, produced from 
the image pixels. Therefore, where appropriate the terms samples and pixels are inter- 
changeable. 

The DCT image Vis fed to an encoding processor 4. The encoding processor 4 
also receives identification code words from an identification code word generator 8. 

The code word generator 8 is provided with a plurality of seeds, each seed 
being used to generate one of the corresponding code words. Each of the generated 
code words may be embedded in a copy of the original image to form a watermarked 
image. The code word generator 8 is provided with a pseudo random number 
generator. The pseudo random number generator produces the code word coefficients 
to form a particular code word. In preferred embodiments the coefficients of the code 
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words are generated in accordance with a normal distribution. However, the 
coefficients of the code word are otherwise predetermined in accordance with the seed, 
which is used to initialise the random number generator. Thus for each code word 
there is a corresponding seed which is stored in a data store 12. Therefore it will be 
understood that to generate the code word JP, seedj is retrieved from memory 12 and 

used to initialise the random number generator within the code word generator 8. 

In the following description the DCT version of the original image is 
represented as V, where; 

^ = {v,} = {v,,v 2 .v 3 ,v 4> v„} 

and v/ are the DCT coefficients of the image. In other embodiments the 
samples of the image v ; - could represent samples of the image in the spatial domain or 
in an alternative domain- 
Each of the code words JO comprises a plurality of n code word coefficients, 

where; 

^=fc}=k*^,*:, jt:} 

The number of code word coefficients n corresponds to the number or samples 
of the original image V. However, a different number of coefficients is possible, and 
will be determined in dependence upon a particular application. 

A vector of code word coefficients JP forming the f-th code word is then passed 
via channel 14 to the encoder 4. The encoder 4 is arranged to form a watermarked 

image Wj by adding the code word JP to the image V. Effectively, therefore, as 
represented in the equation below, each of the code word coefficients is added to a 
different one of the coefficients of the image to forni the watermark image Wj. 

W' = V + X l 

W = v, 4 x' l9 v 2 + x' 19 v 3 v 4 + x<\ v. + x' n 

As shown in Figure 1 , the watermarked images W\ are formed at the output of 

the image processing apparatus by forming inverse DCT of the image produced at the 
output of the encoding processor 4 by the inverse DCT processor 18. 
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Therefore as represented in Figure 1 at the output of the encoder 4 a set of the 
watermarked images can be produced. For a data word of up to 20-bits, one of 10 000 
000 code words can be selected to generate 10 million watermarked versions of the 

original image /. 

Although the code word provides the facility for uniquely identifying a marked 
copy JYj of the image /, in other embodiments the 20 bits can provide a facility for 
communicating data within the image. As will be appreciated therefore, the 20 bits 
used to select the identification code word can provide a 20 bit pay-load for 
communicating data within the image V. 

The encoding image processing apparatus which is arranged to produce the 
watermarked images shown in Figure 1 may be incorporated into a variety of products 
for different scenarios in which embodiments of the present invention find application. 
For example, the encoding image processing apparatus may be connected to a web site 
or web server from which the watermarked images may be downloaded. Before 
downloading a copy of the image, a unique code word is introduced into the 
downloaded image, which can be used to detect the recipient of the downloaded image 
at some later point in time. * 

In another application the encoding image processor forms part of a digital 
cinema projector in which the identification code word is added during projection of 
the image at, for example, a cinema. Thus, the code word is arranged to identify the 
projector and the cinema at which the images are being reproduced. Accordingly, the 
identification code word can be identified within a pirate copy produced from the 
images projected by the cinema projector in order to identify the projector and the 
cinema from which pirate copies were produced. Correspondingly, a watermarked 
image may be reproduced as a photograph or printout in which a reproduction or copy 
may be made and distributed. Generally therefore, the distribution of the watermarked 
images produced by the encoding image processing apparatus shown in Figure 1 is 
represented by a distribution cloud 19. 
Detecting Processor 

A detecting image processing apparatus which is arranged to detect one or 
more of the code words, which may be present in an offending marked image is shown 
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in Figure 2. Generally, the image processor shown in Figure 2 operates to identify one 
or more of the code words, which may be present in an offending, copy of the image. 

The offending version of the watermarked image W is received from a source 
and stored in a frame store 20. Also stored in the frame store 24 is the original version 
of the image /, since the detection process performed by the image processor requires 
the original version of the image. The offending watermarked image W and the 
original version of the image are then fed via respective connecting channels 26, 28 to 
a registration processor 30. 

As already explained, the offending version of the image W may have been 
produced by photographing or otherwise reproducing a part of the watermarked image 
W*. As such, in order to improve the likelihood of detecting the identification code 
word, the registration processor 30 is arranged to substantially align the offending 
image with the original version of the image present in the data stores 20 and 24. The 
purpose of this alignment is to provide a correspondence between the original image 
samples I and the corresponding samples of the watermarked image W* to which the 
code word coefficients have been added. 

The effects of the registration are illustrated in Figure 3. In Figure 3 an 
example of the original image I is shown with respect to an offending marked version 
of the image W\ As illustrated in Figure 3, the watermarked image Wis offset with 
respect to the original image 7 and this may be due to the relative aspect view of the 
camera from which the offending version of the watermarked image was produced. 

In order to recover a representation of the code word coefficients, the correct 
samples of the original image should be subtracted from the corresponding samples of 
the marked offending image. To this end, the two images are aligned. As shown in 
Figure 3, the registered image W'has a peripheral area PA which includes parts which 
were not present in the original image. 

As will be appreciated in other embodiments, the registration processor 30 may 
not be used because the offending image Wmay be already substantially aligned to 
the originally version of the image 7, such as, for example, if the offending version was 
downloaded via the Internet Accordingly, the detecting image processor is provided 
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with an alternative channel 32, which communicates the marked image directly to the 
recovery processor 40. 

The registered image Wis received by a recovery processor 40. The recovery 
processor 40 also receives a copy of the original image / via a second channel 44. The 
registered image Wand the original image / are transformed by a DCT transform 
processor 46 into the DCT domain. An estimated code word X' is then formed by 
subtracting the samples of the DCT domain marked image V from the DCT domain 
samples of the original image Vas expressed by the following equations: 

X'= V- V 

The output of the recovery processor 40 therefore provides on a connecting 
channel 50 an estimate of the coefficients of the code word which is to be identified. 
The recovered code word X' is then fed to a first input of a correlator 52. The 

correlator 52 also receives on a second input the regenerated code words X 1 produced 
by the code word generator 54. The code word generator 54 operates in the same way 
as the code word generator 8 which produces all possible code words of the set, using 
the predetermined seeds which identify uniquely the code words from a store 58. 

The correlator 52 forms n similarity sim{i) values. In one embodiment, the 
similarity value is produced by forming a correlation in accordance with following 
equation: 

, ... X * X X| * Xj H" Xj * ^3 * ^3 * • • "t" X n • X n 

SWJ(l) — f — — I 1 

VA" ■ X' ^x/ • xj + x 2 * ' ■ x\ + x 3 ' • x\ 4- + X,,' - x' 

Each of the n similarity values sim(i) is then fed to a detector 60. The detector 
60 then analyses the similarity values sim(f) produced for each of the n possible code 
words. As an example, the similarity values produced by the correlator 52 are shown 
in Figure 4 with respect to a threshold 77/ for each of the possible code words. As 
shown in Figure 4, two code words are above the threshold, 2001, 12345. As such, the 
detecting processor concludes that the watermarked version associated with code word 
2001 and code word 12345 must have colluded in order to form the offending image. 
Therefore, in accordance with a false poshive detection probability, determined from 
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the population size, which in this case is 10 million and the watermarking strength a , 
the height of the threshold TH can be set in order to guarantee the false detection 
probability. As in the example in Figure 4, if the similarity values produced by the 
correlator 52 exceed the threshold then, with this false positive probability, the 
recipients of the marked image are considered to have colluded to form the offending 

watermarked version of the image W*. 

The following sections provide illustrations of advantages and features of the 
operation of the watermarking system illustrated in Figures 1 and 2. 
Registration 

The process of aligning the offending marked version of the image with the 
copy of the original image comprises correlating the samples of the original image 
with respect to the marked image. The correlation is performed for different shifts of 
the respective samples of the images. This is illustrated in Figure 5. 

Figure 5A provides an illustration of discrete samples of the original image /, 
whereas Figure 5B provides an illustration of discrete samples of the offending 
watermarked image W. As illustrated in the Figures 5A and 5B, the sampling rate 
provides a temporal difference between samples of dt . A result of shifting each of the 
sets of samples from the images and correlating the discrete samples is illustrated in 
Figure 5C. 

As shown in Figure 5C, for a shift of between 6 and 7 samples, the correlation 
peak is highest. However, as illustrated by the continuous line CL formed between the 
samples, the actual peak shift of the original image with respect to the offending 
watermarked image, falls between 6 and 7 samples. 

In preferred embodiments, the registration processor is operable, following the 
detection of a first registration position, to detect a second registration position, which 
is refined with respect to first registration position. To this end, the registration 
processor 30 operates as illustrated in Figure 6. Figures 6A and 6B show the original 
image / and the watermarked offending image W\ but over sampled to twice the 
sampling rate. Correspondingly, therefore, the difference between successive samples 
is dt/2. As can be seen in Figure 6C, the peak value of the correlation between the 
over- sampled versions of the original image and the offending watermarked image 
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falls at 12 samples, which corresponds to an approximate position of the peak of the 
correlation output. It will therefore be appreciated that the registration processor 30 is 
able to provide a more accurate registration of the two images by performing the 
second registration process for the over-sampled version of the original and marked 
images. 

A further advantage provided by the registration processor shown in Figure 2 is 
illustrated in Figure 7. In Figure 7 the registered image W'\ which has been 
reproduced from Figure 3, is shown with respect to the original image /. In order to 
improve the likelihood of detecting the code word within the offending watermarked 
image W'\ the parts of the original image not present in the watermarked image, 
shown as the peripheral area PA are replaced by corresponding parts of the original 
image. This is effected by comparing the mean absolute difference between the 
samples of the original image and the offending watermarked image and if this 
difference exceeds a predetermined threshold, then the samples of the offending 
watermarked image are simply replaced by corresponding samples from the original 
image. This provides a particular advantage in the detection process formed by the 
correlator 52 in combination with the detector 60. This is because, if the parts of the 
marked image PA, which were not present in the original image, are used to form 
recovered code word coefficients these coefficients will not correlate with the 
reproduced version of the code word. These coefficients can produce large values, 
causing significant noise in the correlation sum sim(i). As such, there will be a 
reduced likelihood of the correctly identified code word being above the threshold TH 
for detecting code words in the detector 60. Replacing the parts of the offending 
image with the corresponding parts from the original image, therefore reduces the 
likelihood of a false negative detection, by effectively setting the corresponding 
correlation terms to zero. 
Code Word Generation 

A further advantageous aspect of the embodiment shown in Figures 1 and 2 is 
provided by generating the seed of the random number from which the code word is 
produced from the source image samples. This is affected by analysing the DCT 
coefficients of the image to be watermarked and from these coefficients, generating the 
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seed to be used to generate the code word. This can be effected, for example, by using 
a hashing algorithm known to those skilled in the art as "secure hashing algorithm 1" 
(sha-1). This algorithm forms an ANSI standard (ANSI x9.30-2). This algorithm is 
referred to in a book entitled "Handbook of applied cryptography" by A.J. Menezes. 
As such the seed from the random number can be generated and determined in the 
encoding image processor and the detecting image processor from the DCT 
coefficients. 
Other Applications 

In addition to the above-mentioned applications of the encoding data 
processing apparatus of the watermarking system to a cinema projector and to a web 
server, other applications are envisaged. For example, a receiver/decoder is envisaged 
in which received signals are watermarked by introducing code words upon receipt of 
the signals from a communicating device. For example, a set top box is typically 
arranged to receive television and video signals from a "head-end" broadcast or multi- 
cast device. As will be appreciated in this application, the encoding data processing 
apparatus forms part of the set top box and is arranged to introduce watermark code 
words into the video signals as the signals are received and decoded. In one example 
embodiment, the watermark code word is arranged to uniquely identify the set top box 
which receives and decodes the video signals. 

In a further embodiment a digital cinema receiver is arranged to receive a 
digital cinema film via a satellite. The receiver is arranged to receive signals 
representing the digital cinema film and to decode the signals for reproduction. The 
receiver includes an encoding data processing apparatus, which introduces a 
watermark code word into the decoded film signals. The watermark code word is 
provided, for example, to uniquely identify the cinema receiving the film signals. 

A further example embodiment may comprise a digital camera or camcorder or 
the like which includes a memory and a memory controller. An encoding data 
processing apparatus according to an embodiment of the present invention is arranged 
to introduce a watermark code word stored in the memory into video signals captured 
by the camera. According to this embodiment, the encoding data processing apparatus 
does not include a code word generator because the code word is pre-stored in the 
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memory. Under the control of the memory controller the code word stored in the 
memory is embedded into the video signals, uniquely or quasi-uniquely identifying the 
video signals. 

In a further embodiment, an encoding data processing apparatus according to 
an embodiment of the invention is operable encoded a sequence of watermark code 
words into different frames of digital images forming a continuous or moving picture. 
The code words may be related to one another and may be used to identify each of the 
images separately. 

Various further aspects and features of the present invention are defined in the 
appended claims. Various modifications can be made to the embodiments herein 
before described without departing from the scope of the present invention. 



4 BrieT Description of Drawings 

Figure 1 is a schematic block diagram of an encoding image processing 
apparatus; 

Figure 2 is a schematic block diagram of a detecting image processing 
apparatus; 

Figure 3A is a representation of an original image, Figure 3B is a 
representation of a marked image and Figure 3C is the marked image after registration; 

Figure 4 is a graphical representation of an example correlation result for each 
of a set of N code words; 

Figure 5A is a graphical representation of samples of the original image J, 
Figure 5B is a graphical representation of samples of the watermarked image W; 
Figure 5C is a graphical representation of correlation results for the original image and 
the watermarked image with respect to discrete sample shifts; 

Figure 6A is a graphical representation of an over-sampled version of the 
original image /; Figure 6B is a graphical representation of an over-sampled version of 
the watermarked image W; Figure 6C is a graphical representation of correlation 
results for the over-sampled original image and the watermarked image with respect to 
discrete sample shifts; and 

Figure 7 is a representation illustrating pre-processing of the registered marked 
image with the effect of replacing parts of the marked image not present in the original 
image with corresponding parts of the original image. 



(35) 



JP 2004-40751 A 2004. 2. 5 



1 Abstract 

A watermarking system comprises an encoding data processor operable to 
generate at least one marked version of an original item of material by introducing one 
of a predetermined set of code words into a copy of the original material item. The 
code words are generated from a pseudo-random number generator initialised to a seed 
value. The seed value is used to identify the marked material item, from the code 
word produced from the seed value. The watermarking system also includes a 
detecting data processor operable to identify a particular marked copy of the material 
item by recovering a code word from the marked material item and correlating all code 
words in the set of code words with the recovered code word. The detecting data 
processing apparatus also includes a registration processor operable to associate 
samples of the original material item with corresponding samples of the marked 
material item to which corresponding code word coefficients may have been added. 
By registering the original material item with the marked material item, a likelihood of 
correctly identifying the version of the marked material item is improved, reducing a 
false negative detection probability. 

2 Representative Drawing 

Fig 1 
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